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Abstract Shearlet theory has become a central tool in analyzing and representing 2D 
data with anisotropic features. Shearlet systems are systems of functions generated 
by one single generator with parabolic scaling, shearing, and translation operators 
applied to it, in much the same way wavelet systems are dyadic scalings and trans- 
lations of a single function, but including a precise control of directionality. Of the 
many directional representation systems proposed in the last decade, shearlets are 
among the most versatile and successful systems. The reason for this being an exten- 
sive list of desirable properties: shearlet systems can be generated by one function, 
they provide precise resolution of wavefront sets, they allow compactly supported 
analyzing elements, they are associated with fast decomposition algorithms, and 
they provide a unified treatment of the continuum and the digital realm. 

The aim of this paper is to introduce some key concepts in directional representa- 
tion systems and to shed some light on the success of shearlet systems as directional 
representation systems. In particular, we will give an overview of the different paths 
taken in shearlet theory with focus on separable and compactly supported shearlets 
in 2D and 3D. We will present constructions of compactly supported shearlet frames 
in those dimensions as well as discuss recent results on the ability of compactly sup- 
ported shearlet frames satisfying weak decay, smoothness, and directional moment 
conditions to provide optimally sparse approximations of cartoon-like images in 
2D as well as in 3D. Finally, we will show that these compactly supported shearlet 
systems provide optimally sparse approximations of an even generalized model of 
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cartoon-like images comprising of C 2 functions that are smooth apart from piece- 
wise C 2 discontinuity edges. 



1 Introduction 

Recent advances in modern technology have created a brave new world of enor- 
mous, multi-dimensional data structures. In medical imaging, seismic imaging, as- 
tronomical imaging, computer vision, and video processing, the capabilities of mod- 
ern computers and high-precision measuring devices have generated 2D, 3D, and 
even higher dimensional data sets of sizes that were infeasible just a few years ago. 
The need to efficiently handle such diverse types and huge amounts of data initiated 
an intense study in developing efficient multivariate encoding methodologies in the 
applied harmonic analysis research community. 

In medical imaging, e.g., CT lung scans, the discontinuity curves of the image are 
important specific features since one often wants to distinguish between the image 
'objects' (e.g., the lungs) and the 'background'; that is, it is important to precisely 
capture the edges. This observation holds for various other applications than medi- 
cal imaging and illustrates that important classes of multivariate problems are gov- 
erned by anisotropic features. Moreover, in high-dimensional data most information 
is typically contained in lower-dimensional embedded manifolds, thereby also pre- 
senting itself as anisotropic features. The anisotropic structures can be distinguished 
by location and orientation/direction which indicates that our way of analyzing and 
representing the data should capture not only location, but also directional informa- 
tion. 

In applied harmonic analysis, data is typically modeled in a continuum setting as 
square-integrable functions or, more generally, as distributions. Recently, a novel di- 
rectional representation system - so-called shearlets - has emerged which provides 
a unified treatment of such continuum models as well as digital models, allowing, 
for instance, a precise resolution of wavefront sets, optimally sparse representations 
of cartoon-like images, and associated fast decomposition algorithms. Shearlet sys- 
tems are systems generated by one single generator with parabolic scaling, shearing, 
and translation operators applied to it, in the same way wavelet systems are dyadic 
scalings and translations of a single function, but including a directionality charac- 
teristic owing to the additional shearing operation (and the anisotropic scaling). 

The aim of this survey paper is to introduce the key concepts in directional rep- 
resentation systems and, in particular, to shed some light on the success of shearlet 
systems. Moreover, we will give an overview of the different paths taken in shearlet 
theory with focus on separable and compactly supported shearlets, since these sys- 
tems are most well-suited for applications in, e.g., image processing and the theory 
of partial differential equations. 
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1.1 Directional Representation Systems 

In recent years numerous approaches for efficiently representing directional features 
of two-dimensional data have been proposed. A perfunctory list includes: steer- 
able pyramid by Simoncelli et al. [40], directional filter banks by Bamberger and 
Smith [2], 2D directional wavelets by Antoine et al. [1], curvelets by Candes and 
Donoho [4], contourlets by Do and Vetterli [10], bandlets by LePennec and Mal- 
lat [39], and shearlets by Labate, Weiss, and two of the authors [37]. Of these, 
shearlets are among the most versatile and successful systems which owes to the 
many desirable properties possessed by shearlet systems: they are generated by one 
function, they provide optimally sparse approximation of so-called cartoon-like im- 
ages, they allow compactly supported analyzing elements, they are associated with 
fast decomposition algorithms, and they provide a unified treatment of continuum 
and digital data. 

Cartoon-like images are functions that are C 2 apart from C 2 singularity curves, 
and the problem of sparsely representing such singularities using 2D representation 
systems has been extensively studied; only curvelets [5], contourlets [10], and shear- 
lets [21] are known to succeed in this task in an optimal way (see also Section 3). We 
describe contourlets and curvelets in more details in Section 1 .4 and will here just 
mention some differences to shearlets. Contourlets are constructed from a discrete 
filter bank and have therefore, unlike shearlets, no continuum theory. Curvelets, on 
the other hand, are a continuum-domain system which, unlike shearlets, does not 
transfer in a uniform way to the digital world. It is fair to say that shearlet theory is 
a comprehensive theory with a mathematically rich structure as well as a superior 
connection between the continuum and digital realm. 

The missing link between the continuum and digital world for curvelets is caused 
by the use of rotation as a means to parameterize directions. One of the distinctive 
features of shearlets is the use of shearing in place of rotation; this is, in fact, de- 
cisive for a clear link between the continuum and digital world which stems from 
the fact that the shear matrix preserves the integer lattice. Traditionally, the shear 
parameter ranges over a non-bounded interval. This has the effect that the direc- 
tions are not treated uniformly, which is particularly important in applications. On 
the other hand, rotations clearly do not suffer from this deficiency. To overcome 
this shortcoming of shearing, Guo, Labate, and Weiss together with two of the au- 
thors [37] (see also [20]) introduced the so-called cone-adapted shearlet systems, 
where the frequency plane is partitioned into a horizontal and a vertical cone which 
allows restriction of the shear parameter to bounded intervals (Section 2. 1), thereby 
guaranteeing uniform treatment of directions. 

Shearlet systems therefore come in two ways: One class being generated by a 
unitary representation of the shearlet group and equipped with a particularly 'nice' 
mathematical structure, however causes a bias towards one direction, which makes 
it unattractive for applications; the other class being generated by a quite similar 
procedure, but restricted to cones in frequency domain, thereby ensuring an equal 
treatment of all directions. To be precise this treatment of directions is only 'almost 
equal' since there still is a slight, but controllable, bias towards directions of the 
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coordinate axes, see also Figure 4 in Section 2.2. For both classes, the continuous 
shearlet systems are associated with a 4-dimensional parameter space consisting of 
a scale parameter measuring the resolution, a shear parameter measuring the orien- 
tation, and a translation parameter measuring the position of the shearlet (Section 
1.3). A sampling of this parameter space leads to discrete shearlet systems, and it is 
obvious that the possibilities for this are numerous. Using dyadic sampling leads to 
so-called regular shearlet systems which are those discrete systems mainly consid- 
ered in this paper. It should be mentioned that also irregular shearlet systems have 
attracted some attention, and we refer to the papers [27-29]. We end this section by 
remarking that these discrete shearlet systems belong to a larger class of represen- 
tation systems - the so-called composite wavelets [23-25]. 



1.2 Anisotropic Features, Discrete Shearlet Systems, and Quest for 
Sparse Approximations 

In many applications in 2D and 3D imaging the important information is often 
located around edges separating 'image objects' from 'background'. These fea- 
tures correspond precisely to the anisotropic structures in the data. Two-dimensional 
shearlet systems are carefully designed to efficiently encode such anisotropic fea- 
tures. In order to do this effectively, shearlets are scaled according to a parabolic 
scaling law, thereby exhibiting a spatial footprint of size 2~ 7 times 2~ ; / 2 , where 2 ; 
is the (discrete) scale parameter; this should be compared to the size of wavelet foot- 
prints: 2~J times 2~ 7 . These elongated, scaled needle-like shearlets then parametrize 
directions by slope encoded in a shear matrix. As mentioned in the previous section, 
such carefully designed shearlets do, in fact, perform optimally when representing 
and analyzing anisotropic features in 2D data (Section 3). 

In 3D the situation changes somewhat. While in 2D we 'only' have to handle one 
type of anisotropic structures, namely curves, in 3D a much more complex situation 
can occur, since we find two geometrically very different anisotropic structures: 
Curves as one-dimensional features and surfaces as two-dimensional anisotropic 
features. Our 3D shearlet elements in spatial domain will be of size 2~- / times 2~il 2 
times 2~H 2 which corresponds to 'plate-like' elements as j — > °°. This indicates that 
these 3D shearlet systems have been designed to efficiently capture two-dimensional 
anisotropic structures, but neglecting one-dimensional structures. Nonetheless, sur- 
prisingly, these 3D shearlet systems still perform optimally when representing and 
analyzing 3D data that contain both curve and surface singularities (Section 4). 

Of course, before we can talk of optimally sparse approximations, we need to 
actually have these 2D and 3D shearlet systems at hand. Several constructions of 
discrete band-limited 2D shearlet frames are already known, see [6,20,28,29]. But 
since spatial localization of the analyzing elements of the encoding system is im- 
mensely important both for a precise detection of geometric features as well as 
for a fast decomposition algorithm, we will mainly follow the sufficient conditions 
for and construction of compactly supported cone-adapted 2D shearlet systems by 
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Kittipoom and two of the authors [27] (Section 2.3). These results provide a large 
class of separable, compactly supported shearlet systems with good frame bounds, 
optimally sparse approximation properties, and associated numerically stable algo- 
rithms. 



1.3 Continuous Shearlet Systems 

Discrete shearlet systems are, as mentioned, a sampled version of the so-called con- 
tinuous shearlet systems. These continuous shearlets come, of course, also in two 
different flavors, and we will briefly describe these in this section. 

1.3.1 Cone-Adapted Shearlet Systems 

Anisotropic features in multivariate data can be modeled in many different ways. 
One possibility is the cartoon-like image class discussed above, but one can also 
model such directional singularities through distributions. One would, for example, 
model a one-dimensional anisotropic structure as the delta distribution of a curve. 
The so-called cone-adapted continuous shearlet transform associated with cone- 
adapted continuous shearlet systems was introduced by Labate and the first author 
in [30] in the study of resolutions of the wavefront set for such distributions. It was 
shown that the continuous shearlet transform is not only able to identify the singular 
support of a distribution, but also the orientation of distributed singularities along 
curves. More precisely, for a class of band-limited shearlet generators y/ G L 2 (M 2 ), 
the first author and Labate [30] showed that the wavefront set of a (tempered) dis- 
tribution / is precisely the closure of the set of points (t,s), where the shearlet 
transform of / 

(a,j,0'->(/,a" 3/ V(Afl 1 'Sr 1 (--0)). whereAa= (o fl i/ 2 ) mds * = 

is not of fast decay as the scale parameter a — > 0. Later Grohs [18] extended this 
result to Schwartz-class generators with infinitely many directional vanishing mo- 
ments, in particular, not necessarily band-limited generators. In other words, these 
results demonstrate that the wavefront set of a distribution can be precisely cap- 
tured by continuous shearlets. For constructions of continuous shearlet frames with 
compact support, we refer to [19]. 

1.3.2 Shearlets from Group Representations 

Cone-adapted continuous shearlet systems and their associated cone-adapted con- 
tinuous transforms described in the previous section have only very recently - in 
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2009 - attracted attention. Historically, the continuous shearlet transform was first 
introduced in [20] without restriction to cones in frequency domain. Later, it was 
shown in [7] that the associated continuous shearlet systems are generated by a 
strongly continuous, irreducible, square-integrable representation of a locally com- 
pact group, the so-called shearlet group. This implies that these shearlet systems 
possess a rich mathematical structure, which in [7] was used to derive uncertainty 
principles to tune the accuracy of the shearlet transform, and which in [6] allowed 
the usage of coorbit theory to study smoothness spaces associated with the decay of 
the shearlet coefficients. 

Dahlke, Steidl, and Teschke generalized the shearlet group and the associated 
continuous shearlet transform to higher dimensions M" in the paper [8]. Further- 
more, in [8] they showed that, for certain band-limited generators, the continuous 
shearlet transform is able to identify hyperplane and tetrahedron singularities. Since 
this transform originates from a unitary group representation, it is not able to capture 
all directions, in particular, it will not capture the delta distribution on the xi-axis 
(and more generally, any singularity with l x\ -directions'). We also remark that the 
extension in [8] uses another scaling matrix as compared to the one used for the 
three-dimensional shearlets considered in this paper; we refer to Section 4 for a 
more detailed description of this issue. 



1.4 Applications 

Shearlet theory has applications in various areas. In this section we will present two 
examples of such: Denoising of images and geometric separation of data. Before, 
in order to show the reader the advantages of digital shearlets, we first give a short 
overview of the numerical aspects of shearlets and two similar implementations of 
directional representation systems, namely contourlets and curvelets, discussed in 
Section 1.1. 

Curvelets [3]. This approach builds on directional frequency partitioning and the 
use of the Fast Fourier transform. The algorithm can be efficiently implemented 
using (in frequency domain) multiplication with the frequency response of a filter 
and frequency wrapping in place of convolution and down-sampling. However, 
curvelets need to be band-limited and can only have very good spatial localiza- 
tion if one allows high redundancy. 

Contourlets [10]. This approach uses a directional filter bank, which produces direc- 
tional frequency partitioning similar to those of curvelets. As the main advantage 
of this approach, it allows a tree-structured filter bank implementation, in which 
aliasing due to subsampling is allowed to exist. Consequently, one can achieve 
great efficiency in terms of redundancy and good spatial localization. However, 
the directional selectivity in this approach is artificially imposed by the special 
sampling rule of a filter bank which introduces various artifacts. We remark that 
also the recently introduced Hybrid Wavelets [17] suffer from this deficiency. 
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(a) Original image (b) Noisy image 




(c) Denoised using curvelets (d) Denoised using shearlets 




(e) Denoised using curvelets (zoom) (f) Denoised using shearlets (zoom) 

Fig. 1 Denoising of the Goldhill image (512 x 512) using shearlets and curvelets. The noisy image 
in (b) has a peak signal-to-noise ratio of 20.17 dB. The curvelet-denoised image in (c) and (e) has 
a PSNR of 28.70 dB, while the shearlet-denoised image in (d) and (f) has a PSNR of only 29.20 
dB. 



8 



Gitta Kutyniok, Jakob Lemvig, and Wang-Q Lim 



Shearlets [38]. Using a shear matrix instead of rotation, directionality is natu- 
rally adapted for the digital setting in the sense that the shear matrix preserves 
the structure of the integer grid. Furthermore, excellent spatial localization is 
achieved by using compactly supported shearlets. The only drawback is that 
these compactly supported shearlets are not tight frames and, accordingly, the 
synthesis process needs to be performed by iterative methods. 

To illustrate how two of these implementations perform, we have included a 
denoising example of the Goldhill image using both curvelets 1 and shearlets, see 
Figure 1 . We omit a detailed analysis of the denoising results and leave the visual 
comparison to the reader. For a detailed review of the shearlet transform and asso- 
ciated aspects, we refer to [14, 16, 36, 38]. We also refer to [26, 35] for MRA based 
algorithmic approaches to the shearlet transform. 

The shearlet transform, in companion with the wavelet transform, has also been 
applied to accomplish geometric separation of 'point-and-curve' -like data. An artifi- 
cially made example of such data can be seen in Figure 2a. For a theoretical account 
of these separation ideas we refer to the recent papers by Donoho and the first au- 
thor [12, 13]. Here we simply display the result of the separation, see Figure 2. For 
real-world applications of these separation techniques we refer to the paper [33] on 
neurobiological imaging. 




(a) Original point-curve data (b) Separated point-like data (c) Separated curve-like data 
of size 256 x 256. (captured by wavelets). (captured by shearlets). 



Fig. 2 Geometric separation of mixed 'point-and-curve' data, (a): Input data, (b) and (c): The 
output of the separation algorithm. 

In the spirit of reproducible research [15], we wish to mention that Figure Id, 
If and 2 have been produced by the discrete shearlet transform implemented in the 
Matlab toolbox Shearlab which has recently been released under a GNU license and 
is freely available at http : / / www . shearlab . org. 



Produced using Curvelab (Version 2.1.2), which is available from http : //curvelet . org. 
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In Section 2 we present a review of shearlet theory in L 2 (R 2 ), where we focus 
on discrete shearlet systems. We describe the classical band-limited construction 
(Section 2.2) and a more recent construction of compactly supported shearlets (Sec- 
tion 2.3). In Section 3 we present results on the ability of shearlets to optimally 
sparsely approximate cartoon-like images. Section 4 is dedicated to a discussion on 
similar properties of 3D shearlet systems. 

2 2D Shearlets 

In this section, we summarize what is known about constructions of discrete shear- 
let systems in 2D. Although all results in this section can easily be extended to 
(irregular) shearlet systems associated with a general irregular set of parameters for 
scaling, shear, and translation, we will only focus on the discrete shearlet systems 
associated with a regular set of parameters as described in the next section. For a 
detailed analysis of irregular shearlet systems, we refer to [27]. We first start with 
various notations and definitions for later use. 

2.1 Preliminaries 

For j>0,k£Z, let 

A ^(o#)' s '=(!!)' and Mc= (oc° 2 )' 

where c = {c\,C2) and c\,C2 are some positive constants. Similarly, we define 

5). * -(!!)• and *-(?')■ 

Next we define discrete shearlet systems in 2D. 

Definition 1. Let c = (c u c 2 ) E (R+) 2 . For </>, \ff, y e L 2 (R 2 ) the cone-adapted 2D 
discrete shearlet system SH(ty,y, \j/;c) is defined by 

SH(<j),\i/, f;c) = 0(^;c 1 )Uf(v/;c)U , f'(v/;c), 

where 

0(<j>;c\) = {<j)(--m) : m G qZ 2 }, 

f(y/-;c) = {2^ j \j/{S k A 2] ■ -m) : ; > 0, - [2^ 2 1 < k < [2 j/2 ],m e M C Z 2 }, 
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and 

V(\fr;c) = {2?jy{S k A 2 j ■ -m) : j > 0, - \2 J ' 2 ] <k< \2 j/2 ],m G M C I?}. 

If y/, y7;c) is a frame for L 2 (R 2 ), we refer to as a scaling function and y/ 

and y> as shearlets. 

Our aim is to construct compactly supported functions <p , y/, and y/ to obtain com- 
pactly supported shearlets in 2D. For this, we will describe general sufficient con- 
ditions on the shearlet generators y/ and y>, which lead to the construction of com- 
pactly supported shearlets. To formulate our sufficient conditions on y/ and y/ (Sec- 
tion 2.3), we will first need to introduce the necessary notational concepts. 
For functions , y/, y7 e L 2 (M 2 ), we define : R 2 x R 2 ->• R by 

0(S,a>) = \$G)\\$(S + a>)\ + G l {S,<o) + G 2 G,a>), (1) 

where 

®i(«,ffl) = L £ |v>(^A 2 -^)||vV(^ r A 2 -^ + (»)| 

i>0|i:|<[2J/ 2 l 

and 

2 (£,C0)=£ £ |v>(^A 2 -^)||v>(^A 2 -^ + ©)|. 

./>0|Jt|<["2// 2 l 

Also, for c=(ci,c 2 ) G (M+) 2 , let 

m<EZ 2 \{0} 

+ (r 2 (M t 7 1 m)r 2 (-M c 7 1 m))2, 

where 

Io(co) = esssup|0(<!;)||0(<i; + 0))| and 17(a)) = ess sup ©,(<!;, ft)) for; = 1,2. 

£eR 2 ' ' £eR 2 



2.2 Classical Construction 

We now first describe the construction of band-limited shearlets which provides 
tight frames for L 2 (R 2 ). Constructions of this type were first introduced by Labate, 
Weiss, and two of the authors in [37]. The classical example of a generating shearlet 
is a function y/ G L 2 (R 2 ) satisfying 
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where G L 2 (R) is a discrete wavelet, i.e., satisfies the discrete Calderon condition 
given by 

Y,\Vi{2~ j %)\ 2 = 1 for a.e. 4 G R, 

jez 

with G C°°(R) and suppi/^ C [— |, — ^] U |], and G L 2 (R) is a bump func- 
tion, namely 

E |v/ 2 (^+^)| 2 -l fora.e.§G[-l,l], 

satisfying y>2 G C°° (R) and supp f^C [—1,1]. There are several choices of y/\ and l/Zj 
satisfying those conditions, and we refer to [20] for further details. The tiling of the 




Fig. 3 The cones '€\ - ^4 and the Fig. 4 Tiling of the frequency 

centered rectangle ,5? in the fre- domain induced by band-limited 

quency domain. shearlets. 



frequency domain given by these band-limited generators and choosing \jf(x\ ,^2) = 
\j/(x2,xi ) is illustrated in Figure 4. As described in Figure 3, a conic region U^3 is 
covered by the frequency support of shearlets in f ( y/; c ) while ^2 U ^4 is covered by 
^¥(y/;c). For this particular choice, using an appropriate scaling function for the 
centered rectangle S% (see Figure 3), it was proved in [20, Thm. 3] that the associated 
cone-adapted discrete shearlet system SH(<p, y/, iff; (1, 1)) forms a Parseval frame for 
L 2 (R 2 ). 



2.3 Constructing Compactly Supported Shearlets 

We are now ready to state general sufficient conditions for the construction of shear- 
let frames. 

Theorem 1 ([27]). Let <j), y G L 2 (R 2 ) be functions such that 

^(^,fe)<C 1 -min{l,|^r r }-min{l,|fer r } 

and 
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\mi^2)\<C 2 -mm{l^}-mm{l,\^\-y}-mm{l^ 2 \-r}, (2) 

for some positive constants C\ , C 2 < 00 and a > y > 3. Define \jf(xi ,x 2 ) = \j/(x 2 ,X\ ), 
and let Lj n f,L sup be defined by 

L; n f = ess inf (E, , 0) am/ L S up = ess sup @ (4,0). 

Suppose that there is a constant L; n f > such that < L m f < L; n f. 77zen f/zere exist 
a sampling parameter c = (ci , c 2 ) with c\ ~ c 2 and a constant L sup < °° such that 

R(c) < L inf < L inf andh mp < L sup , 

and, further, SH((j),\l/, \jf;c) forms a frame for L 2 (W 2 ) with frame bounds A and B 
satisfying 

J^f inf -R{c)] <A<B< J^[Ls UP+ R(c)]. (3) 

For a detailed proof, we refer to the paper [27] by Kittipoom and two of the authors. 

Obviously, band-limited shearlets (from Section 2.2) satisfy condition (2). More 
interestingly, also a large class of spatially compactly supported functions satisfies 
this condition. In fact, in [27], various constructions of compactly supported shear- 
lets are presented using Theorem 1 and generalized low-pass filters; an example of 
such a construction procedure is given in Theorem 2 below. In Theorem 1 we as- 
sumed c\ = c 2 for the sampling matrix M c (or M c ), the only reason for this being 
the simplification of the estimates for the frame bounds A, B in (3). In fact, the esti- 
mate (3) generalizes easily to non-uniform sampling constants c\,c 2 with ci ^ c 2 . 
For explicit estimates of the form (3) in the case of non-uniform sampling, we refer 
to [27]. 

The following result provides a specific family of functions satisfying the general 
sufficiency condition from Theorem 1 . 

Theorem 2 ([27]). Let K,L>0 be such that L> 10 and ^ < K <3L- 2, and define 
a shearlet y € L 2 (R 2 ) by 

MS) =m 1 (4§ 1 )^(| 1 )^(2&) ) 4 = 6 K 2 , 

where mo is the low pass filter satisfying 

M40I 2 = (cos^)) 2 * £ ( K ~ 1 +H ) (sin(^!)) 2 ", G R, 

m\ is the associated bandpass filter defined by 

\ mi (^)\ 2 = \m (^ + l)\ 2 , 4i G M, 
and <j) is the scaling function given by 
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<^i) = n™o(2-^i), ^el. 

7=0 

Then there exists a sampling constant c\>0 such that the shearlet system f (i/a;c) 
forms a frame for U ^3) := {/ G L 2 (R 2 ) : supp f C^iU^} for any sam- 

pling matrixM c with c — (c\ 7 C2) G (R+) 2 and C2 < c\ < c\. 

For these shearlet systems, there is a bias towards the vertical axis, especially 
at coarse scales, since they are defined for L 2 { c <a\ U^), and hence, the frequency 
support of the shearlet elements overlaps more significantly along the vertical axis. 
In order to control the upper frame bound, it is therefore desirable to apply a denser 
sampling along the vertical axis than along the horizontal axis, i.e., c\ > C2- 

Having compactly supported (separable) shearlet frames for L 2 (^i U^) at hand 
by Theorem 2, we can easily construct shearlet frames for the whole space L 2 (R 2 ). 
The exact procedure is described in the following theorem from [27]. 

Theorem 3 ([27]). Let y/ G L 2 (R 2 ) be the shearlet with associated scaling function 
01 G L 2 (R) both introduced in Theorem 2, and set §(x\,X2) = 0i(^i)0i(^2) ^nd 
Wi x U x 2) = W( x 2,xi). Then the corresponding shearlet system SH(§ ,y ,y;c) forms 
a frame forL 2 (R 2 ) for any sampling matrices M c andM c with c = (ci,C2) G (R+) 2 
andc2 < c\ < C\. 

For the horizontal cone ^\ U ^3 we allow for a denser sampling by M c along the 
vertical axis, i.e., ci<c\, precisely as in Theorem 2. For the vertical cone ^U^t 
we analogously allow for a denser sampling along the horizontal axis; since the 
position of c\ and C2 is reversed in M c compared to M c , this still corresponds to 

c 2 < c\. 

We wish to mention that there is a trade-off between compact support of the 
shearlet generators, tightness of the associated frame, and separability of the shear- 
let generators. The known constructions of tight shearlet frames do not use sep- 
arable generators (Section 2.2), and these constructions can be shown to not be 
applicable to compactly supported generators. Tightness is difficult to obtain while 
allowing for compactly supported generators, but we can gain separability as in 
Theorem 3, hence fast algorithmic realizations. On the other hand, when allowing 
non-compactly supported generators, tightness is possible, but separability seems to 
be out of reach, which makes fast algorithmic realizations very difficult. 

We end this section by remarking that the construction results above even gener- 
alize to constructions of irregular shearlet systems [28,29]. 



3 Sparse Approximations 

After having introduced compactly supported shearlet systems in the previous sec- 
tion, we now aim for optimally sparse approximations. To be precise, we will show 
that these compactly supported shearlet systems provide optimally sparse approxi- 
mations when representing and analyzing anisotropic features in 2D data. 
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3.1 Cartoon-Like Image Model 



Following [11], we introduce STAR 2 (v), a class of sets B with C 2 boundaries dB 
and curvature bounded by v, as well as S 2 (R 2 ), a class of cartoon-like images. For 
this, in polar coordinates, we let p : [0,27c) — > [0, 1] be a radius function and define 
the set B by 

B = {x G R 2 : \x\ < p(6),x= (\x\,9) in polar coordinates}. 
In particular, we will require that the boundary dB of B is given by the curve 

m -{p(e)sm(6))> (4) 
and the class of boundaries of interest to us are defined by 

sup|p"(0)| < v, p<p <l, (5) 

where Po < 1 needs to be chosen so that y + B C [0, 1 ] 2 for some y G K 2 . 
The following definition now introduces a class of cartoon-like images. 

Definition 2. For v > 0, the set STAR 2 (v) is defined to be the set of all B C [0, l] 2 
such that B is a translate of a set obeying (4) and (5). Further, <f 2 (R 2 ) denotes the 
set of functions / G L 2 (M. 2 ) of the form 

f = fo+fiXB, 

where B G STAR 2 (v) and / ,/i G C^(M 2 ) with supp/} C [0,1] 2 and \\fj\y = 
I|a|<2l|O a /;-|U< 1 for/ =1,2. 

One can also consider a more sophisticated class of cartoon-like images, where the 
boundary of B is allowed to be piecewise C 2 , and we refer to the recent paper by 
two of the authors [34] and to similar considerations for the 3D case in Section 4.2. 

Donoho [11] proved that the optimal approximation rate for such cartoon-like 
image models / G (? 2 (K 2 ) which can be achieved for almost any representation sys- 
tem under a so-called polynomial depth search selection procedure of the selected 
system elements is 

||/-/yv|l2<C-^V- 2 asJV^- 

where is the best Af-term approximation of /. As discussed in the next section 
shearlets in 2D do indeed deliver this optimal approximation rate. 



3.2 Optimally Sparse Approximation of Cartoon-Like Images 

Let SH((j),\i/,\j/;c) be a shearlet frame for L 2 (R 2 ). Since this is a countable set 
of functions, we can denote it by SH(<j>,\j/,\ff;c) = ((7,), e /. We let (<7,-),- e / be a 
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dual frame of (ai)iei- As our jV-term approximation fy of a cartoon-like image 
/ G <f v 2 (R 2 ) by the frame SH(<j),Y, T,c), we then take 

fN= E tf> a t) & h 

iei N 

where ((/, a,-)),-g/ w are the N largest coefficients (/, a,-) in magnitude. As in the tight 
frame case, this procedure does not always yield the best N-term approximation, 
but, surprisingly, even with this rather crude selection procedure, we can prove an 
(almost) optimally sparse approximation rate. We speak of 'almost' optimality due 
to the (negligible) log-factor in (6). The following result shows that our 'new' com- 
pactly supported shearlets (see Section 2.3) deliver the same approximation rate as 
band-limited curvelets [5], contourlets [10], and shearlets [21]. 

Theorem 4 ([32]). Let c > 0, and let i/a G L 2 (R 2 ) be compactly supported. 
Suppose that, in addition, for all ^ = ^2) G R 2 , the shearlet \j/ satisfies 



(i) 
(ii) 



m)\<Ci-mm{l,\^\ a }-mm{l,\^\-r}-mm{l^ 2 \- r } and 
^(§)|<|*(«i)|-(l + |g|)" r . 



where a > 5, J > 4, h G L l (R), and C\ is a constant, and suppose that the shearlet 
y/ satisfies (i) and (ii) with the roles of %\ and ^2 reversed. Further, suppose that 
SH((j>, y, \jr\c) forms a frame for L 2 (R 2 ). 

Then, for any V > 0, the shearlet frame SH(<j), fy',c) provides (almost) opti- 
mally sparse approximations of functions f G cf 2 (R 2 ) in the sense that there exists 
some C > such that 

||/-^||2<C-A^ 2 -(logA0 3 asN^~, (6) 

where fy is the nonlinear N-term approximation obtained by choosing the N largest 
shearlet coefficients of f. 

Condition (i) can be interpreted as both a condition ensuring (almost) separable 
behavior as well as a moment condition along the horizontal axis, hence enforc- 
ing directional selectivity. This condition ensures that the support of shearlets in 
frequency domain is essentially of the form indicated in Figure 4. Condition (ii) 
(together with (i)) is a weak version of a directional vanishing moment condition 2 , 
which is crucial for having fast decay of the shearlet coefficients when the corre- 
sponding shearlet intersects the discontinuity curve. Conditions (i) and (ii) are rather 
mild conditions on the generators; in particular, shearlets constructed by Theorem 2 
and 3, with extra assumptions on the parameters K and L, will indeed satisfy (i) 
and (ii) in Theorem 4. To compare with the optimality result for band-limited gen- 
erators we wish to point out that conditions (i) and (ii) are obviously satisfied for 
band-limited generators. 



2 For the precise definition of directional vanishing moments, we refer to [10]. 
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We remark that this kind of approximation result is not available for shearlet 
systems coming directly from the shearlet group. One reason for this being that 
these systems, as mentioned several times, do not treat directions in a uniform way. 



4 Shearlets in 3D and Beyond 

Shearlet theory has traditionally only dealt with representation systems for two- 
dimensional data. In the recent paper [8] (and the accompanying paper [9]) this 
was changed when Dahlke, Steidl, and Teschke generalized the continuous shear- 
let transform (see [7, 30]) to higher dimensions. The shearlet transform on L 2 (R") 
by Dahlke, Steidl, and Teschke is associated with the so-called shearlet group in 
M \ {0} x W~ 1 x W, with a dilation matrix of the form 

A a = diag (a, sgn(a) \a\ l/n , . . . , sgn(a) \a | 1/n ) , a G M\{0}, 

and with a shearing matrix with n — 1 shear parameters s = (s\ , . . . ) eR"- 1 of 
the form 

s I 1 s ' 

where /„ denotes the n x n identity matrix. This type of shearing matrix gives rise to 
shearlets consisting of wedges of size cT l x aT x l n x • • • x cT l l n in frequency domain, 
where a -1 ^> aT x l n for small a > 0. Hence, for small a > 0, the spatial appearance 
is a surface-like element of co-dimension one. 

In the following section we will consider shearlet systems in L 2 (R 3 ) associ- 
ated with a sightly different shearing matrix. More importantly, we will consider 
pyramid-adapted 3D shearlet systems, since these systems treat directions in a uni- 
form way as opposed to the shearlet systems coming from the shearlet group; this 
design, of course, parallels the idea behind cone-adapted 2D shearlets. In [22], the 
continuous version of the pyramid-adapted shearlet system was introduced, and it 
was shown that the location and the local orientation of the boundary set of cer- 
tain three-dimensional solid regions can be precisely identified by this continuous 
shearlet transform. The pyramid-adapted shearlet system can easily be generalized 
to higher dimensions, but for brevity we only consider the three-dimensional setup 
and newly introduce it now in the discrete setting. 



4.1 Pyramid-Adapted Shearlet Systems 

We will scale according to paraboloidal scaling matrices Ay, Ay or Ay, j £ Z, and 
encode directionality by the shear matrices S^, S^, or S^, k — (fci,^) G defined 
by 



Compactly Supported Shearlets 



17 



(v o o \ fyi 2 o o \ /2'/ 2 o 

A 2J = 2^ 2 , A 2J = 2> , and A 2 ,= 2'/ 2 

\o o 2>/ 2 / V o o yi 2 ) \ 2^ 

and 



S* = 1 , S t = Ui 1 k 2 , and Si = 






respectively. The translation lattices will be defined through the following matrices: 
M c = diag(ci,C2,C2), M c = diag(c2,ci,C2), andM c = diag(c2,C2,ci), where c\ > 
and C2 > 0. 



Fig. 5 The partition of the fre- 
quency domain: The centered 
rectangle ffi. The arrangement 
of the six pyramids is indi- 
cated by the 'diagonal' lines. 
See Figure 6 for a sketch of 
the pyramids. 




We next partition the frequency domain into the following six pyramids: 



& x = 





> 3 :&>1, 




< 1, 




<1} 


I 


= 1, 


el 


* 3 :&>1, 




< 1, 




<1} 


1 


-2, 


el 


1. 




< 1, 


fe/<^3 


<1} 


I 


= 3, 




:|i<-l, 




< 1, 




<1} 


I 


= 4, 




:&<-!, 




< 1, 




<1} 


1 


= 5, 




:&<-!, 




< 1, 




<1} 


1 


= 6, 



and a centered rectangle 

# = eR^||(&,&,&)||..<l}. 

The partition is illustrated in Figures 5 and 6. This partition of the frequency 
space allows us to restrict the range of the shear parameters. In the case of 'shear- 
let group' systems one must allow arbitrarily large shear parameters, while the 
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'pyramid-adapted' systems restrict the shear parameters to [— 1~2 ; '/ 2 ], |~2 ; '/ 2 ]]. It is 
exactly this fact that gives a more uniform treatment of the directionality properties 
of the shearlet system. 




(a) Pyramids 9\ (b) Pyramids (c) Pyramids 2?-$ 

and #4 and the |i and ^5 and the £2 an( l ^6 an d the £3 
axis. axis. axis. 



Fig. 6 The partition of the frequency domain: The 'top' of the six pyramids. 

These considerations are now made precise in the following definition. 

Definition 3. For c = [c\,C2.) E (R+) 2 , the pyramid-adapted 3D shearlet system 
SH(<j>,y, \fr, \j/;c) generated by <j>,y,\jjr, \j/ e L 2 (R 3 ) is defined by 

SH(<j),Y, y, y;c) = 0(0;c 1 )Uf (y;c)U l P(y;c)UV(y;c), 

where 

<P{(p;ci) = {<j) m = 0(--m) : mGciZ 3 }, 

f (y;c) = {Wj,k.m = 2 j w(SkA 2J ■ -m) : j > 0, \k\ < \V'\m E M,Z 3 } , 
>¥(y;c) = {y hLm = 2 j y(S k A 2 j ■ -m) : j > 0, \k\ < \V'\m e M,Z 3 }, 

and 

W(r,c) = {w jXm = 2 j y(S k A 2J ■ -m) :j>0, \k\ < [2^ 2 ],m E M,Z 3 }, 

where j E No and k E Z 2 . Here we have used the vector notation \k\ < K for k — 
(£1 ,£2) and K > to denote \k\ \ < K and \k 2 \ < K. 

The construction of pyramid-adapted shearlet systems SH(<p,y,y,y;c) runs 
along the lines of the construction of cone-adapted shearlet systems in L 2 (M 2 ) de- 
scribed in Section 2.3. For a detailed description, we refer to [31]. 

We remark that the shearlets in spatial domain are of size 2~ ; / 2 times 2~ ; / 2 times 
2~ ; which shows that the shearlet elements will become 'plate-like' as j — > °° One 
could also use the scaling matrix A 2 j = diag (2- 7 ,2- 7 , 2 ; / 2 ) with similar changes for 
A 2 j and A 2 j- This would lead to 'needle-like' shearlet elements instead of the 'plate- 
like' elements considered in this paper, but we will not pursue this further here, and 
simply refer to [3 1] . More generally, it is possible to even consider non-paraboloidal 
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scaling matrices of the formA,- = diag(2-',2 a -',2^-') forO < a, j3 < 1 . One drawback 
of allowing such general scaling matrices is the lack of fast algorithms for non- 
dyadic multiscale systems. On the other hand, the parameters a and j3 allow us to 
precisely shape the shearlet elements, ranging from very plate-like to very needle- 
like, according to the application at hand, i.e., choosing the shearlet-shape that is the 
best 'fit' for the geometric characteristics of the considered data. 



4.2 Sparse Approximations of 3D Data 

We now consider approximations of three-dimensional cartoon-like images using 
shearlets introduced in the previous section. The three-dimensional cartoon-like im- 
ages <f 2 (R 3 ) will be piecewise C 2 functions with discontinuities on a closed C 2 
surface whose principal curvatures are bounded by v. In [31] it was shown that the 
optimal approximation rate for such 3D cartoon-like image models / e <§ 2 (R 3 ) 
which can be achieved for almost any representation system (under polynomial 
depth search selection procedure of the approximating coefficients) is 

where fy is the best A^-term approximation of /. The following result shows that 
compactly supported pyramid-adapted shearlets do (almost) deliver this approxima- 
tion rate. 



Theorem 5 ([31]). Let c e (R+) 2 , and let <j> , y, iff, iff g L 2 (R 3 ) be compactly sup- 
ported. Suppose that, for all E, = (^1,^2^3) £ R 3 , me function \jf satisfies: 



0) 
(ii) 



^)|<Ci-nrin{l^ 1 r}.niin{lJ| 1 |-r}™{lJfe|-r}. ni in{l,||3|-r}, 
4^)|<|/^i)l'(l + i)~ r (l + i)~ r , ' = 2,3, 



where a > 8, y > 4, t M> th{t) G L 1 (R), and C\ a constant, and suppose that \j/ and 
iff satisfy analogous conditions with the obvious change of coordinates. Further, 
suppose that the shearlet system SH((j),\l/, iff, iff;c) forms a frame for L 2 (R 3 ). 

Then, for any V > 0, the shearlet frame SH((j),Y, iff, iff',c) provides (almost) opti- 
mally sparse approximations of functions f E <§ 2 (R 3 ) in the sense that there exists 
some C > such that 

\\f-f N \\2<C-N- l -(l gN) 2 asN^oo. (7) 

In the following we will give a sketch of the proof of Theorem 5 and, in partic- 
ular, give a heuristic argument (inspired by a similar one for 2D curvelets in [5]) to 
explain the exponent A^ 1 in (7). 



Proof (Theorem 5, Sketch). Let / e <fy(R 3 ) be a 3D cartoon-like image. The main 
concern is to derive appropriate estimates for the shearlet coefficients (f,Wj,k.m)- 
We first observe that we can assume the scaling index j to be sufficiently large, 
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since / as well as all shearlet elements are compactly supported and since a finite 
number does not contribute to the asymptotic estimate we are aiming for. In par- 
ticular, this implies that we do not need to take frame elements from the 'scaling' 
system &(<j>;c\) into account. Also, we are allowed to restrict our analysis to shear- 
lets Yjkmt since the frame elements xjfjkm an d Wjkm can be handled in a similar 
way. 

Letting |0(/)|« denote the nth largest shearlet coefficient (/, y/j.k.m) m absolute 
value and using the frame property of SH(<j),y, y/, \f/;c), we conclude that 

\\f-fN\\ 2 2<jj:mf)\i 

A n>N 

for any positive integer N, where A denotes the lower frame bound of the shear- 
let frame SH((j),\ir, \jf, y/;c). Thus, for completing the proof, it therefore suffices to 
show that 

E le^l^C-Ar^logAO 2 asJV^- (8) 

n>N 

For the following heuristic argument, we need to make some simplifications. We 
will assume to have a shearlet of the form y(x) ~ r](xi)(p(x2)(p(xi), where r\ is a 
wavelet and <p a bump (or a scaling) function. Note that the wavelet 'points' in the 
short direction of the plate-like shearlet. We now consider three cases of coefficients 

(f,Yj,k, m y 

(a) Shearlets W/jt m whose support does not overlap with the boundary dB. 

(b) Shearlets y/j^.m whose support overlaps with dB and is nearly tangent. 

(c) Shearlets V0',*,m whose support overlaps with dB, but not tangentially. 




(a) Sketch of shearlets whose 
support does not overlap 
with dB. 




(b) Sketch of shearlets whose 
support overlaps with dB and 
is nearly tangent. 




(c) Sketch of shearlets whose 
support overlaps with dB, 
but not tangentially. 



Fig. 7 The three types of shearlet yfjjcjn boundary dB interactions considered in the heuristic 
argument (explaining the approximation rate N~ l ). Note that only a section of dB is shown. 



As we argue in the following, only coefficients from case (b) will be significant. 
Case (b) is - loosely speaking - the situation in which the wavelet Tj breaches, in an 
almost normal direction, through the discontinuity surface; as is well known from 
wavelet theory, ID wavelets efficiently handle such a 'jump' discontinuity. 
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Case (a). Since / is C 2 smooth away from dB, the coefficients | (f, y/j,k.m) I will 
be sufficiently small owing to the wavelet 77 (and the fast decay of wavelet coeffi- 
cients of smooth functions). 

Case (b). At scale j > 0, there are at most 0(2 j ) coefficients, since the plate-like 
elements are of size 2~i/ 2 times 2~->/ 2 (and 'thickness' 2~ ; ). By assumptions on / 
and the support size of V}',S:,m> we obtain the estimate 

I (/, Wj,k,m) I < H/L \\WjXm\\l < C l (2^') 1/2 \\WUk, m \\l 2 < C 2 

for some constants C\,Ci > 0. In other words, we have 0(2 j ) coefficients bounded 
by C2 ■ 2~ J . Assuming the case (a) and (c) coefficients are negligible, the nth largest 
coefficient \ 9(f )\ n is then bounded by 

\d(f)\n <C-n~\ 

Therefore, 

E \e{f)\l<Y,C-n- 2 <C- / x- 2 dx<C-N- 1 

n>N n>N Jn 

and we arrive at (8), but without the log-factor. This in turn shows (7), at least 
heuristically, and still without the log-factor. 

Case (c). Finally, when the shearlets are sheared away from the tangent position 
in case (b), they will again be small. This is due to the vanishing moment conditions 
in condition (i) and (ii). □ 

Clearly, Theorem 5 is an 'obvious' three-dimensional version of Theorem 4. 
However, as opposed to the two-dimensional setting, anisotropic structures in three- 
dimensional data comprise of two morphologically different types of structure, 
namely surfaces and curves. It would therefore be desirable to allow our 3D im- 
age class to also contain cartoon-like images with curve singularities. On the other 
hand, the pyramid-adapted shearlets introduced in Section 4.1 are plate-like and 
thus, a priori, not optimal for capturing such one-dimensional singularities. Surpris- 
ingly, these plate-like shearlet systems still deliver the optimal rate A^ 1 for three- 
dimensional cartoon-like images £ 2 L (M?), where L indicates that we allow our dis- 
continuity surface dB to be piecewise C 2 smooth; L e N is the maximal number 
of C 2 pieces and v > is an upper estimate for the principal curvatures on each 
piece. In other words, for any v > and L e N, the shearlet frame SH((j> , y/, \jf, iff; c) 
provides (almost) optimally sparse approximations of functions / e <sy L (R 3 ) in the 
sense that there exists some C > such that 

||/-/;v||2<C-A^ 1 -(logA0 2 asJV^-. (9) 

The conditions on the shearlets y/, iff, iff are similar to these in Theorem 5, but 
more technical, and we refer to [3 1] for the precise statements and definitions as well 
as the proof of the optimal approximation error rate. Here we simply remark that 
there exist numerous examples of shearlets y/, iff, and iff satisfying these conditions, 
which lead to (9); one large class of examples are separable generators iff, iff € 
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L 2 (R 3 ), i.e., 

Y(x) = ri(x l )(p{x2)(p(x 3 ), = (p{xi)n(X2)(P{X3), f(x) = (p{xi)(p(X2)T}{X3), 

where 77, (p E L 2 (R) are compactly supported functions satisfying: 



(i) 
(ii) 



f)(0))| <Ci •min{l,|o| a }-min{l,|a)|-''}, 
(&sYQ(a>) <C 2 -min{l>|-r} for* = 0,1, 



for (oel, where a > 8, 7 > 4, and Ci,C2 are constants. 



5 Conclusions 

Designing a directional representation system that efficiently handles data with 
anisotropic features is quite challenging since it needs to satisfy a long list of desired 
properties: it should have a simple mathematical structure, it should provide opti- 
mally sparse approximations of certain image classes, it should allow compactly 
supported generators, it should be associated with fast decomposition algorithms, 
and it should provide a unified treatment of the continuum and digital realm. 

In this paper, we argue that shearlets meet all these challenges, and are, therefore, 
one of the most satisfying directional systems. To be more precise, let us briefly 
review our findings for 2D and 3D data: 

• 2D Data. In Section 2, we constructed 2D shearlet systems that efficiently capture 
anisotropic features and satisfy all the above requirements. 

• 3D Data. In 3D, as opposed to 2D, we face the difficulty that there might exist 
two geometrically different anisotropic features; ID and 2D singularities. The 
main difficulty in extending shearlet systems from the 2D to 3D setting lies, 
therefore, in introducing a system that is able to represent both these geometri- 
cally different structures efficiently. As shown in Section 4, a class of plate-like 
shearlets is able to meet these requirements. In other words: the extension from 
2D shearlets to 3D shearlets has been successful in terms of preserving the de- 
sirable properties, e.g., optimally sparse approximations. It does therefore seem 
that an extension to 4D or even higher dimensions is, if not straightforward then, 
at the very least, feasible. In particular, the step to 4D now 'only' requires the 
efficient handling of yet 'another' type of anisotropic feature. 
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